System and methods for controlling a surveying device

ABSTRACT

A system and methods are provided for controlling a surveying device. In one embodiment, a method includes displaying a control screen including image data captured by a surveying device, detecting an input associated with the control screen, and determining a control command for the surveying device based on the input associated with the control screen. The method may further include controlling operation of the surveying device based on the control command, wherein the surveying device is configured to rotate in one more of a horizontal and vertical direction based on the control command. The device and methods may advantageously allow for precise pointing of a surveying device and translation of input position to surveying device commands.

CROSS-REFERENCE TO RELATED APPLICATION

The application claims priority to U.S. Provisional Application No.61/549,431 filed on Oct. 20, 2011, and entitled “Systems and Methods forControlling a Surveying Device”, the disclosure of which is herebyincorporated by reference in its entirety.

FIELD

The present disclosure relates generally to electronic devices andmethods, and more particularly to a system and methods for controlling asurveying device.

BACKGROUND

Current solutions for control of operation of a surveying device allowfor controlled aim of the surveying device. Similar conventionalfeatures include imaging capabilities of surveying devices. Adjustmentof the surveying device may be based on an optical eyepiece or one ormore targets, such as a tracked or locked prism. Although conventionalmethods allow for controlled movement of a surveying device, many ofthese systems do not allow for precise control. Another drawback may bedifficulty in aiming or controlling a device from a distance. Further,the conventional devices and methods, do not allow for precise controlof a surveying device using a control screen. Once conventional approachis to control of surveying device employs based on an input vector,wherein the vector input may be used to control the position of thesurveying device. In many cases, input vectors do not allow for finitecontrol of the surveying device. The vector inputs are difficult tocontrol for measuring varying distances. It may be difficult to point asurveying device at varying distances using a control device asconventional approaches do not account for the distance of a target.Similarly, these input controls have limited functionality. Thus,improved control of surveying devices is desired to allow for improvedcontrol and reduce time required for measurements.

BRIEF SUMMARY OF THE EMBODIMENTS

Disclosed and claimed herein are a device and methods for controlling asurveying device. In one embodiment, a method includes displaying, by adevice, a control screen including image data captured by a surveyingdevice, detecting an input associated with the control screen, anddetermining a control command for the surveying device based on theinput associated with the control screen. The method further includescontrolling, by the device, operation of the surveying device based onthe control command, wherein the surveying device is configured torotate in one more of a horizontal and vertical direction based on thecontrol command. Other aspects, features, and techniques will beapparent to one skilled in the relevant art in view of the followingdetailed description of the embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS

The features, objects, and advantages of the present disclosure willbecome more apparent from the detailed description set forth below whentaken in conjunction with the drawings in which like referencecharacters identify correspondingly throughout and wherein:

FIG. 1 depicts a simplified system diagram according to one or moreembodiments;

FIG. 2 depicts a process for controlling a surveying device according toone or more embodiments;

FIGS. 3A-3B depict a simplified block diagrams of devices according toone or more embodiments;

FIGS. 4A-4D depict graphical representations of translating inputassociated with a control screen to commands for a surveying deviceaccording to one or more embodiments;

FIG. 5 depicts a graphical representation of dynamic joystickfunctionality according to one or more embodiments;

FIGS. 6A-6C depict graphical representations of dynamic joystickfunctionality according to one or more embodiments;

FIG. 7 depicts a graphical representation of dynamic joystick controlscreen according to one or more embodiments;

FIGS. 8A-8C depict graphical representations of wand functionalityaccording to one or more embodiments;

FIGS. 9A-9D depict one or more processes for providing wandfunctionality according to one or more embodiments;

FIGS. 10A-10C depict graphical representations of a control screen andsmart zoom functionality according to one or more embodiments; and

FIGS. 11A-11B depict graphical representations of smart zoomfunctionality according to one or more embodiments.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS Overview andTerminology

One aspect of the disclosure relates controlling operation of asurveying device based on an input contact, such as touch or stylusmovement and positioning, relative to a display of image data capturedby the surveying device. In one embodiment, a control device may betranslate commands, such as a touch, drag, tap, stylus movement, etc.,to one or more commands for controlling a pointing direction and/orimaging attribute of a surveying device. According to anotherembodiment, input commands may be based on contact, or touch, of adisplay associated with a surveying device, such as a total station. Thecontrol device may be configured to display image or video data receivedfrom the surveying device. The control device may allow for controlsignals to be provided to a surveying device that react directly toinputs of displayed image data. One advantage of the controlfunctionality described herein may be improved control of a surveyingdevice from a distance. Another advantage may be to provide precisecontrol of a surveying device from a display screen.

In one embodiment, control of a surveying device may be based on contactand motion of a stylus relative to a display screen. Dynamic joystickfunctionality can translate contact with the control device to commandsfor the surveying device. By translating contact commands associatedwith the control device to commands for the surveying device, greatercontrol of the surveying device may be provided. In addition, thecontrol device may be configured to characterize the input commandsbased on one or more selected control features. As will be discussed inmore detail below, control features may soften or alter the response onthe surveying device to input commands, lock an axis to provide movementin another desired axis, suppress movement in an axis, and/or scaleinput commands based on distance to a target.

Another embodiment of the disclosure is directed to providing motionbased control for controlling and/or positioning a surveying device. Themotion based control, or wand functionality, as described herein may bebased on motion of a control device. In one embodiment, movement of thewand may be translated for adjusting orientation of the surveyingdevice. Wand operation may be based on determination of tilt andacceleration of the wand control, which may then be used to determineone or more control commands for the surveying device. Detection andcharacterization of wand motion may be translated for controlling zoomand rotating a surveying device, such as a total station, in one or moredirections. Wand position may be based on position of a laser element ofthe surveying device.

In yet another embodiment, a device and method are provided forcontrolling zoom and providing aim and zoom control by a contact commandassociated with a display screen. A control device may be configured totoggle between one or more zoom configurations, camera selection, and/orselection of zoom areas based on input commands relative to a displayscreen. As will be discussed below, control of the surveying device maybe based on single or multiple contact commands. Control of thesurveying device may additionally be based on detection of an input withrespect to a position of a display screen.

Embodiments are directed to systems including devices for controlling asurveying device. In one embodiment, a device with a display may beconfigured to control a surveying device, such as a total station. Inanother embodiment, a system may be provided including motion sensingdevice, such as a wand, wherein manipulation or gesturing of the wandmay be employed to control the surveying device. As discussed herein, asurveying device may relate to one or more devices configured formeasurement or determination of coordinates, angular measurements,positioning, and distance measurement. Although the description belowrefers to a surveying device as a total station or robotic totalstation, it should be appreciated that the methods and devices describedherein may relate to surveying devices and other devices in general. Inone or more embodiments, a surveying device may include a display forpresenting image data, such as video data captured by one or more imagedetectors of the surveying device. A surveying device may additionallyinclude one or more pointing devices, such as a laser pointer. Imagedata detected by a surveying device and presented by the surveyingdevice of controller may be associated with a position of the laserpointer of the surveying device. In yet another embodiment, the controlcommands as discussed herein may be employed for controlling a robotictotal station, or other adjustable device with respect to one or moreaxes.

As used herein, the terms “a” or “an” shall mean one or more than one.The term “plurality” shall mean two or more than two. The term “another”is defined as a second or more. The terms “including” and/or “having”are open ended (e.g., comprising). The term “or” as used herein is to beinterpreted as inclusive or meaning any one or any combination.Therefore, “A, B or C” means “any of the following: A; B; C; A and B; Aand C; B and C; A, B and C”. An exception to this definition will occuronly when a combination of elements, functions, steps or acts are insome way inherently mutually exclusive.

Reference throughout this document to “one embodiment,” “certainembodiments,” “an embodiment,” or similar term means that a particularfeature, structure, or characteristic described in connection with theembodiment is included in at least one embodiment. Thus, the appearancesof such phrases in various places throughout this specification are notnecessarily all referring to the same embodiment. Furthermore, theparticular features, structures, or characteristics may be combined inany suitable manner on one or more embodiments without limitation.

In accordance with the practices of persons skilled in the art ofcomputer programming, one or more embodiments are described below withreference to operations that are performed by a computer system or alike electronic system. Such operations are sometimes referred to asbeing computer-executed. It will be appreciated that operations that aresymbolically represented include the manipulation by a processor, suchas a central processing unit, of electrical signals representing databits and the maintenance of data bits at memory locations, such as insystem memory, as well as other processing of signals. The memorylocations where data bits are maintained are physical locations thathave particular electrical, magnetic, optical, or organic propertiescorresponding to the data bits.

When implemented in software, the elements of the embodiments areessentially the code segments to perform the necessary tasks. The codesegments can be stored in a processor readable medium, which may includeany medium that can store or transfer information. Examples of theprocessor readable mediums include an electronic circuit, asemiconductor memory device, a read-only memory (ROM), a flash memory orother non-volatile memory, a floppy diskette, a CD-ROM, an optical disk,a hard disk, a non-transitory medium, etc.

Exemplary Embodiments

Referring now to the figures, FIG. 1 depicts a simplified system diagramaccording to one or more embodiments. According to one embodiment,control device 105 may be configured to control operation of surveyingdevice 110. Control device 105 may relate to an electronic device orportable computing device, such as a tablet. Device 105 may includedisplay 115 configured to display a user interface for controlling oneor more of control device 105 and surveying device 110. In anotherembodiment, display 115 may be configured to display image data, such asvideo data or one or more images received from surveying device 110. Asdepicted in FIG. 1, control device 105 may communicate by wired and/orwireless communication with surveying device 110 via communication path125. In certain embodiments, display 115 may provide a control screen tocontrol operation of the surveying device.

Surveying device 110 may be configured for determination and measurementof one or more of angular offset, height, length, distance, andcoordinate determination. Surveying device may additionally beconfigured for controlled aim, pointing, imaging, performing stake outmeasurements, projection of planes, 3D projections, and providingelectronic distance measurements. In that fashion, surveying device 110may be employed for use in one or more of surveying, engineering, andconstruction. Surveying device 110 may include display 120 configured todisplay a user interface, image data detected by surveying device 110.In certain embodiments, display 120 may provide a control screen tocontrol operation of the surveying device. Display screen 120 may betouch sensitive. In certain embodiments, either of display 115 anddisplay 120 may be optional. Surveying device 110 may include one ormore elements for projections, including projection of 3D points. Asdepicted in FIG. 1, control device 105 and surveying device 110 eachincluding a display. However it should be appreciated that in certainembodiments, control device 105 may be integrated with surveying device110.

As will be discussed herein, elements of system 100 may be configured toprovide precise control of surveying device 110 and overcome one or moredrawbacks of conventional devices and methods. By way of example, system100 may be configured to provide devices and methods for controlling,aiming, or pointing of surveying device 110 based on touch or stylusinputs to a display, such as display 115 or display 120. Translatingcontact with a display may be generally referred to as dynamic joystickfunctionality. According to another embodiment, control of surveyingdevice 110 may be based on motion of control device 105, wherein controldevice 105 relates to an electronic device configured to sense andtranslate motion or gestures. This functionality is discussed below aswand functionality. In yet another embodiment, control of surveyingdevice 110 may be based one or more commands detected based on contactwith a display screen for adjusting zoom and/or position. Thesefunctions are discussed below as smart zoom functionality below. Itshould be appreciated that these features may be provided by singlecontrol device according to one or more embodiments, such as either ofcontrol device 105 or surveying device 110.

Referring now to FIG. 2, a process is depicted for controlling asurveying device according to one or more embodiments. Process 200 maybe employed by a device (e.g., control device 105) to control asurveying device (e.g., surveying device 110) according to one or moreembodiments.

Process 200 may be initiated by displaying a control screen at block205. The control screen may include image data captured by the surveyingdevice, such as a series of still images or video data. The image datamay relate to an area that a surveying device is aimed. Image dataassociated with the orientation of the survey device may be displayed ona touch screen. The control device and/or surveying device may beconfigured to store image data displayed by the control screen. Process200 is described with respect to a control screen of a control device;however, it may be appreciated that a control device of a surveyingdevice may function in a similar manner.

At block 210, the control device may be configured to detect an inputassociated with the control screen. In one embodiment, the input may bebased on contact with the control screen by one or more of a tapcommand, series of taps, drag command or movement relative to thecontrol screen. The input may be based on user touch or contact with thecontrol screen by a stylus or other input device. In certainembodiments, the input may be based on motion of the control device,such as a tilt or acceleration of the control device with respect to oneor more axes. Other motion inputs may relate to gesture based commandsor commands relative to an initial reference position of the controldevice. Control inputs may be generated based on a reaction to directinput of display image data.

At block 215, the control device may determine a control command for thesurveying device based on the input associated with the control screen.The control command may be determined based on tracking motion ofcontact with the control screen, such as by a tracking routine. Thecontrol command may adjust the position (e.g., orientation, aim, angularrotation, etc.) of the surveying device based on characteristics of theinput command. The control command may be a translation of contact withthe control screen to control movement of the surveying device. Forexample, a drag command may relate to rotation of the surveying devicein one or more of horizontal and vertical directions. According to oneembodiment, the control command detected at block 215 may be generatedbased on one or more features to allow for greater control of thesurveying device. The control command may be based on a sensitivity modewherein the control device is configured to adjust the position of thesurveying device relative to half the distance of the input.Alternatively, or in combination, the control command may adjust thesurveying device in a direction opposite to the input command. Thecontrol command may ignore movement of the input command with respect toan axis or suppress movement in the one axis (e.g., a vertical axis)relative to another axis (e.g., a horizontal axis). In anotherembodiment, the control command can scale the movement of the inputcommand based on a distance measurement performed by the surveyingdevice. Input commands may be processed or determined based oncharacteristics of the inputs.

In one embodiment, process 200 may determine a control command byinitiating tracking routine of the input command based on contact to thecontrol screen. The tracking routine may be performed while the input(e.g., user touch or stylus), is in contact with the control screen. Thecontrol device may update the display of the control screen based onimage data received from the surveying device following the controlcommand.

At block 220, the control device can control operation of the surveyingdevice based on the control command. The surveying device may beconfigured to reorient, such as rotate in one more of a horizontal andvertical direction. Alternatively, or in combination, a surveying devicemay modify a zoom setting based on the control command. Control of thesurveying device allows for seamless change of image data on the controlscreen. Control may be tied to input movement. For continuous moment,the surveying device may be controls to re-orient based on the amountand speed of the input. In that fashion, the control device may set thespeed and amount of rotation.

Referring now to FIGS. 3A-3B, simplified block diagrams are depicted ofdevice configurations according to one or more embodiments. Referringfirst to FIG. 3A, a simplified block diagram is depicted of a controldevice. Device 300 may be configured to provide one or more ofdirectional, motion or control commands to a surveying device, such as atotal station. In certain embodiments, device 300 relates to controldevice 105 of FIG. 1. Device 300 may be configured to execute anapplication for communicating with or controlling operation of asurveying device (e.g., surveying device 110). Device 300 may be one ormore of a display device, communication device, survey controller,mobile device, tablet, computing device, or electronic device ingeneral.

As depicted in FIG. 3A, device 300 includes processor 305, memory 310,input/output (I/O) interface 315, communication interface 320, display325 and detection module 330. Elements of device 300 may be configuredto communicate and interoperate with processor 305 by a communicationbus. Processor 305 may be configured to control operation of device 300,or another device, based on one or more computer executable instructionsstored in memory 310. In one embodiment, processor 305 may be configuredto detect an input associated with a control screen and controloperation of a surveying device. Memory 310 may relate to one of RAM andROM memories and may be configured to store one or more files, andcomputer executable instructions for operation of device 300. Althoughdepicted as a single memory unit, memory 310 may relate to one or moreof internal device memory and removable memory. Memory 310 may storeimage data, zoom positions, selected targets and stylus movements.

Input output (I/O) interface 315 may be configured to output data and/orcommands to one or more output devices. According to one embodiment, I/Ointerface 315 may be configured to receive one or more user commands.I/O interface 315 may include one or more buttons to control operationof device 300 including controlling selection of content for display andcontrolling operation of device 300. Input buttons of I/O interface 315may include one or more buttons for user input, such as a such as anumerical keypad, volume control, menu controls, pointing device, trackball, mode selection buttons, and survey functionality (e.g., coordinatemeasurement, angular measurement, marking, aiming, etc). Input buttonsof I/O interface 315 may include hard and soft buttons, whereinfunctionality of the soft buttons may be based on one or moreapplications running on device 300.

Communication interface 320 may include one or more elements to allowfor communication by device 300 by wired or wireless communication.Communication interface 320 may include one or more ports for receivingdata, including ports for removable memory. Communication interface 320may be configured to allow for network based communications includingbut not limited to LAN, WAN, Wi-Fi, etc.

In certain embodiments, device 300 may include display 325 to displayimage data, such as video data and graphics data, alert messages, anddisplay one or more applications executed by processor 305. By way ofexample, display 325 may be configured to display video image datadetected by a surveying device. Display 325 of device 300 may beconfigured to display one or more of a user interface, and image datadetected by an image detector of a surveying device. In certainembodiments, display 325 may be a touch screen configured to detectcontact, dragging, tap(s), and/or stylus operation. In that fashion,display 325 may be a control screen. Display may be configured toidentify projection points of a 3D data.

Device 300 may optionally include one or more motion sensors 326. Incertain embodiments, motion of device 300 may be detected to controloperation of a surveying device. Motion sensors 326 may be configured todetect and characterize motion of the control device, such as a wand,and determine one or more commands for operating a surveying device. Incertain embodiments, motion sensors 326 may be configured to detectionmotion relative to a horizontal axis and vertical axis. Motion sensors326 may include one or more of an accelerometer, gyroscopic sensor,single axis sensors and multiple axis sensors.

Referring now to FIG. 3B, a simplified block diagram is depicted of asurveying device, according to one or more embodiments. In certainembodiments, device 350 relates to surveying device 110 of FIG. 1.Device 350 may be configured to provide an application for communicatingwith a control device (e.g., control device 105) or controllingoperation of the surveying device. Elements of device 350 may functionsimilarly to elements of device 300 described above. Device 350 may beconfigured to receive one or more directional, motion or controlcommands for control.

According to one embodiment, communication interface 320 may beconfigured for communication with one or more control devices (e.g.,control device 105). For example, in one embodiment, communicationinterface 320 may be configured to receive directional commands from thecontrol device. Device 350 may be configured to translate the receiveddirectional command to control operation of surveying device, such asrotation, zoom, repositioning, setting aim, pointing the device, etc. Inother embodiments, communication interface 320 may be configured toreceive control commands for controlling operation of device 350.

Display 325 of device 350 may be configured to display one or more of auser interface, cross hairs, and image data detected by an imagedetector of device 350. In certain embodiments, display 325 may be atouch screen configured to detect contact, dragging, tap(s), and/orstylus operation. In that fashion, display 325 may be a control screenon a surveying device.

Laser/electronic distance measuring (EDM) module 330 of device 350 maybe configured for pointing the surveying device and electronicallymeasuring distance from the surveying device to a measurement position.In certain embodiments, a laser generated by module 330 may be focusedfor increased visibility. A laser generated by module 330 may beemployed for aiming surveying device 350.

According to one embodiment, surveying device 350 may include one ormore image detectors depicted as 335. Image detectors 335 may relate toone or more cameras or imaging devices configured to detect image orvideo data. Image detectors 335 may allow for a plurality of focallengths to provide a plurality of zoom levels. Zoom levels of theimaging devices 335 may be based on one or more inputs associated with acontrol screen of a control device.

Surveying device 350 may include servo controls 340 configured to rotatethe surveying device camera and/or pointer relative to a horizontal axisand vertical axis. Servo controls may be configured to adjust positionof surveying device 350 relative to tracking of inputs to a controldevice. In certain embodiments, servo controls may mimic or translatereceived inputs of a control screen by adjusting the aim or orientationof surveying device 350.

Dynamic Joystick Functionality

According to one embodiment, a system and methods may be provided forcontrolling aiming or pointing of a surveying device based on touch orstylus inputs to a display, such as a control screen. These functionsare generally referred to as dynamic joystick functionality. Dynamicjoystick functionality may be accessible during surveying device setupand during data collection. Dynamic joystick functionality mayincorporate one or more of the features described herein with respect tothe wand and smart zoom functionalities.

Referring now to FIGS. 4A-4D, graphical representations are depicted oftranslating a control screen input to commands for a surveying device.Referring first to FIG. 4A, a graphical representation is depicted ofsystem 400 including control device 405 and surveying device 410.Control device 405 may be configured to communicate with surveyingdevice 410 by wired or wireless communication depicted as 406. Surveyingdevice 410 is depicted as a total station including imaging device 415,laser module 420, vertical adjustment 425, and horizontal adjustment430. Surveying device 410 may additionally include antenna 450 forreceiving and transmitting control data. In certain embodiments, imagingdevice 415 of surveying device 410 may include more than one camera forcapturing still and video image data.

Control device 405 may include display panel 455. At least a portion ofdisplay panel 455 may present control screen 460 including image orvideo data received from surveying device 410. Control screen 460 maydisplay one or more user interface elements such as crosshairs 465.Crosshairs 465 may overlay image data to identify a position of a laserpointer of surveying device 410. According to one embodiment, dynamicjoystick functionality may be provided to allow for a user of controldevice 405 to precisely point surveying device 410, a laser of surveyingdevice 410, and control camera zoom. Based on detection of an inputcommand, control device 405 may transmit one or more commands to rotatesurveying device 410 horizontally, as shown by directions 440 and 445,and/or vertically, as shown by direction 435. Dynamic joystickfunctionality may additionally provide one or more control features fortranslating contact position and speed of surveying device commands.

FIG. 4B depicts a graphical representation of an input associated withcontrol screen 460. According to one embodiment, control screen 460 maybe displayed based on activation of a visualization button on controldevice 405 or surveying device 410. Display of control screen 460 mayinitialize dynamic joystick operation. Similarly, contacting controlscreen 460 via touch or a stylus may initialize a tracker routine toconvert user inputs to instrument commands. Dragging a stylus acrosscontrol screen 460, which may display image data or map data, cangenerate one or more commands for adjusting the horizontal or verticalposition of surveying device 410. Lifting the stylus, or contact, maydeactivate the tracker routine.

Contact of control screen 460, as depicted by 466, may be detected bycontrol device 405. When contact 466 is initiated, control device 405may initiate a tracking routine to determine the end point, shown as 467and input path 468. Based on one or more of contact 466, end point 467and input path 468, the control device may determine a control commandfor operation of surveying device 410, such as rotation or repositioningof surveying device 410. Contact 466 and/or input path 468 may bedetected based on use of a stylus, or detection of user contact ofcontrol screen 460. By detecting an input, or contact, with respect tocontrol screen 460 and displaying image data detected by surveyingdevice 410, control device 405 may precisely point surveying device 410based on the displayed image data.

According to one embodiment, dynamic joystick functionality may provideone or more features to translate input position and path to surveyingdevice commands. The basic movement and control of the dynamic joystickfunctionality may be enhanced by one or more features, including but notlimited to a sensitivity mode, invert vertical axis mode, axis lockmode, suppressed vertical axis mode, and distance scaling mode.Referring now to FIG. 4C, a graphical representation is depicted ofjoystick functionality features for additional contact 466, end point467, and input path 468. Contact points may be imitated any where onscreen for a drag movement.

According to one embodiment, a sensitivity mode can allow a user toselect a coarse or fine adjustment. In the fine mode, surveying device410 may be configured to move at roughly half the distance relative to acoarse mode for the same distance traveled by the stylus, or inputcontact. The fine mode may allow for more precise control for pointing alaser of surveying device 410, while the coarse mode may allow for quickpositioning of the laser in an area of interest. Thus, by way ofexample, input path 468 in a fine mode may control surveying device tobe repositioned to a smaller distance relative to repositioning in acoarse mode.

According to one embodiment, a suppressed vertical axis mode may resultin reduced movement with respect to one axis input movement. Forexample, movement in the vertical axis of an input command may bereduced relative to movement in the horizontal axis. As depicted in FIG.4C, input path 468 detected by a control device may result in terminalpoint 469 with path 470 based on a suppressed vertical axis mode. Whenthe suppressed vertical axis mode is activated, surveying device 410will move a laser roughly half the distance in the vertical axisrelative to motion in the horizontal axis for the same movement. Thisfeature may be employed to overcome the effects of using a laser at anangle to a surface such as a ceiling or floor when a small movement inthe input, or stylus, translates to a large movement across the surface.

FIG. 4C also depicts an axis lock mode. According to one embodiment, anaxis lock mode allows an axis to be locked in either the horizontal orvertical direction. When an axis is locked, movement of the input forthe unlocked axis is ignored. As depicted in FIG. 4C, input path 468detected by a control device may result in terminal point 471 with path472 based on a locked vertical axis.

According to one embodiment, invert vertical axis mode can allow for auser to move a stylus, or present an input command, in the up directionthat will cause the laser pointer and aim of the surveying device tomove in a down direction, or vice versa. The invert vertical axis modemay be toggled on or off by a user. As depicted in FIG. 4D, startingpoint 473 and input path 473 detected by a control device may result interminal point 476 with path 475 based on an invert vertical axis mode.

According to one embodiment, distance scaling mode allows for a distancemeasuring capability of surveying device 410 to scale inputs received oncontrol screen 460. For example, the farther away a surface is fromsurveying device 410, the less sensitive control device 405 may be toinputs, such as stylus inputs. As a result, movement of a laser ofsurveying device 410 relative to an input, such as a stylus, may be moreconsistent at varying distances. According to one embodiment, thedistance scaling mode may only operate when a surveying device is intracking mode.

Referring now to FIG. 5, a graphical representation is depicted ofdynamic joystick functionality according to one or more embodiments.FIG. 5 depicts layers of the dynamic joystick functionality for handlinginputs and interfacing with devices. According to one embodiment,dynamic joystick functionality may include user interface layer 505 toaddress user inputs and initialization of routines. Interface layer 505may allow a tracking routine to be initiated and terminated. Frameworklayer 510 may provide core algorithms for coding and overall function ofa control device and surveying device. Instrument manager layer 515 mayprovide an interface for instrument drivers, wherein instrument driverlayer 520 controls instrument operation. In certain embodiments,instrument driver 520 may, or may not, be provided on a control device.

FIGS. 6A-6C depict graphical representations of dynamic joystickfunctionality according to one or more embodiments. According to oneembodiment, the functions described in FIGS. 6A-6C may be performed byan application of a control device and/or surveying device. Referringfirst to FIG. 6A, dynamic joystick functionality may be initiated duringpresentation of a joystick input screen or control screen at block 605.FIG. 6A depicts functionality associated with the initial detection ofan input to a control screen. The input may be based on video or imagedata displayed by a device, such as a control device.

At decision block 610, screen visibility may be checked to determine ifimage data is displayed by a control screen. When image data is notdisplayed (e.g., “NO” path out of decision block 610), the dynamicjoystick functionality continuously checks for screen display. Whenimage data is displayed (e.g., “YES” path out of decision block 610),such as video data associated with a surveying device and/or laserlocation, operation of the dynamic joysticks operation is initialized.The functionality may allow for detecting input to a control screen,such as contact of a stylus or touch. Based on a detected input, acontrol device may start a timer (e.g., 50 ms) at block 620 to determinean initial position of an input (e.g., stylus contact, tap, etc.) atblock 625. The dynamic joystick functionality may also allow fordetection of a mouse or scrolling command in the up or down direction atblock 630 relative to a control screen and enabling a tracker routine atblock 635. Based on one or more user selections, features such as asensitivity mode and distance scaling, may be toggled at block 640 andenabled at block 645.

Referring now to FIG. 6B, dynamic joystick functionality is depicted fortranslating a detected input to commands for a surveying device.Functionality to initialize operation at block 615, process position atblock 625, enable a tracking routine at block 635, and enable featuresat block 645 may be employed for generating commands for a surveyingdevice. Based on position processed at block 625 and a tracking routineenabled at block 635, the control device may check if the tracker isenabled for the detected input at decision block 650. When the trackingroutine is not enabled (e.g., “NO” path out of decision block 650), thecontrol device checks if the input has a speed of zero or is coasting.When the tracking routine is enabled (e.g., “YES” path out of decisionblock 610), the control device can calculate axis angles for a desiredposition of a surveying device at block 660. Calculating angles for thesurveying device at block 660 may be based on default values set for asurveying device at block 665, and one or more features such assensitivity mode at block 670, distance scaling at block 671, and asuppressed axis at 672. The set default values of block 665 may be basedon a particular starting position or aim for the surveying device. Basedon calculated axis angles at block 660, the control device may calculatea desired instrument speed a block 674. The calculated instrument speedat block 674 may be based on the speed or other characteristics of aninput to a control device. In addition, the calculated instrument speedmay be based on a determination at decision block 673 that the speed ofthe input is not zero (e.g., an input such as a stylus is dragged ormoved across at least a portion of the control screen). Based on acalculated instrument speed at block 674, the control device maygenerate a command for the surveying device to initiate motion and setthe velocity at block 676. When decision block 673 determines that thespeed of the input is zero, the control device may send a command tostop the instrument at block 675.

FIG. 6C depicts functionality for terminating or continuing instrumentmotion according to one or more other embodiments. Based on adetermination at block 675 to stop motion of the surveying instrument,stylus operation may be terminated at block 677. By way of example, thecontrol device may cease the tracking routine of a particular input.Following the termination of stylus operation at block 677, the controldevice may initiate another adjustment by detecting an input or contactto the control screen. According to another embodiment, the controldevice may allow for controlling movement of the surveying device tomimic or translate input commands of the control screen. Once thevelocity of the surveying device has been set at block 676, the controldevice may check to determine if stylus operation has been created atblock 678. Stylus operation may allow for continuous motion of thesurveying device based on motion of the stylus with respect to thecontrol screen. When the stylus operation has not been created (e.g.,“NO” path out of decision block 678), stylus operation may be created atblock 679. When the stylus operation has been created (e.g., “YES” pathout of decision block 678), the control device can perform stylusoperation at block 680 by detecting the motion of the stylus withrespect to the control device and adjusting the surveying device aimwith a determined velocity at block 690.

FIG. 7 depicts a graphical representation of dynamic joystick controlscreen according to one or more embodiments. In one embodiment, controlscreen 700 may be displayed by one a control device (e.g., controldevice 105). In another embodiment, control screen 700 may be displayedby a surveying device (e.g., surveying device 110). Control screen 700may include display window 705. Display window 705 may include imageand/or video data captured by a surveying device based on themeasurement area associated with a laser of the surveying device. Crosshairs 710 may identify the position of a laser of the surveying deviceand may be overlaid on image data in display window 705. A controldevice may be configured to detect an input to display window 705, suchas a touch command, stylus command, tap or drag. In certain embodiments,control screen 700 may include display of message 715 to provide noticeto a user that the device is ready to a dynamic joystick command.

Control screen 700 may include feature boxes 720 to allow a user totoggle one or more features of the dynamic joystick functionality. Bychecking a box, such as a horizontal axis lock box, the control devicemay be configured to suppress the motion of the surveying device in eachof the unselected axes based on a detected input command.

Wand Functionality

Wand functionality may provide control of a surveying device based onmotion of a control device. The control device may relate to anelectronic device having a display and may include motion sensingelements. Wand functionality may incorporate one or more of the featuresdescribed herein with respect to the dynamic joystick and smart zoomfunctionalities.

Referring now to FIGS. 8A-8C, graphical representations are depicted ofwand functionality. FIG. 8A depicts a simplified system diagram of wandfunctionality according to an exemplary embodiment. Control device 805may be configured to transmit a control command for controllingoperation of surveying device 810 according to one or more embodiments.Control device includes display area 815, which may be configured todetect touch screen commands or inputs from a stylus. In certainembodiments, wand functionality may be initiated by a user contactingbutton 820 of the control device or a particular portion of display area815, for example area 825. A wand command may then be entered while thebutton is depressed of following activation of the button. As depictedin FIG. 8A, control device 805 may be moved up (e.g., direction A inFIG. 8A), down (e.g., direction B in FIG. 8A), left (e.g., direction Cin FIG. 8A), or right (e.g., direction D in FIG. 8A). One or more of themovements may be translated by the control device to a control commandfor turning or adjusting aim of surveying device 800. In an exemplaryembodiment, moving control device 805 up (e.g., direction A in FIG. 8A)may translate to a control command to move the camera of the surveyingdevice up, and similarly moving control device 805 down (e.g., directionB in FIG. 8A) moves the camera down. Moving control device in ahorizontal direction may translate to a control command for rotating thesurveying device in a horizontal direction. For example, left (e.g.,direction C in FIG. 8A) rotates surveying device counter-clockwise, andright (e.g., direction D in FIG. 8A) may rotating the device clockwise.

According to another embodiment, wand functionality may be provided by acontrol device without a display, such as a wand or control device. FIG.8B depicts a graphical representation of a control device as a wand,wherein motion of the wand may be detected and translated to one or morecommands for surveying device 810. A control device may be repositionedas depicted in FIG. 8B, from position 830 to position 835. Repositioningas depicted in FIG. 8B may relate to horizontal motion (e.g., directionD in FIG. 8A). In certain embodiments, the motion of the wand may bedetected when button 836 of the wand device is activated, or for aperiod of time following activation. FIG. 8C depicts repositioning formposition 840 to position 845 which may relate to vertical motion (e.g.,direction A in FIG. 8A).

FIGS. 9A-9D depict one or more processes for providing wandfunctionality. Referring first to FIG. 9A, a process is depicted foroutput of a control command. Process 900 may be initiated by measuring acurrent tilt of the control device (e.g., Control device 805) in the xand y directions (e.g., directions A- B, and C- D, respectively) atblock 905. Following a gesture of command by the user, such as motiondepicted in any of FIGS. 8A-8C, the control device may calculate turningspeeds for a controlled instrument (e.g., surveying device 810) at block910. According to one embodiment, the surveying device may be configuredto turn at one or more turning speeds. In certain embodiments, a usermay select from two or more turning speeds. The control device mayoutput the turn values to the surveying device at block 915.

FIG. 9B depicts a process for adjusting a surveying device (e.g.,surveying device 810). Process 920 may be initiated by receivingcontroller acceleration values in the horizontal and vertical directions(e.g., directions A-B, and C-D, respectively) at block 925. Thesurveying device may then calculate turning speeds at block 930. Thesurveying device may then adjust the position or aim of the instrumentbased on the turn values at block 935. Mapping between tilted andacceleration values in processes 900 and 920 can be calibrated to allowfor instrument turning depending on one or more features of the dynamicjoystick module including a sensitivity mode, invert vertical axis mode,axis lock mode, suppressed vertical axis mode, and distance scalingmode.

FIG. 9C depicts a process for output of a control command by a controldevice (e.g., control device 805). Process 940 may be initiated bydetecting wand tilt at block 945, the wand tilt relating to an initialreference position. The control device may then measure tilt of an inputcommand at block 950 and calculate turning speed of a surveying deviceat block 955 based on the measured tilt. The control device may thentransmit the command to the surveying device to initiate deviceadjustment at block 960. The control device may transmit a commandincluding an end adjustment command at block 965 when user motion of thecontrol device has terminated.

FIG. 9D depicts a process for output of a control command by a controldevice (e.g., control device 805). Process 970 may be initiated bydetecting wand acceleration at block 975, the wand acceleration relativeto one or more axes. The control device may then determine accelerationof input command at block 980 and calculate frequency of a turning speedat block 985 based on the determined acceleration. The control devicemay then transmit a command to the surveying device to initiate deviceturning at block 990, wherein the surveying device may turn according tothe determined direction and calculated speed.

Smart Zoom Functionality

In yet another embodiment, control of a surveying device may be basedone or more commands detected based on contact with a display screen foradjusting zoom and/or aim position. Control of the surveying device by avideo screen for controlling zoom and instrument turning may be providedby smart zoom functionality. Smart zoom functionality may incorporateone or more of the features described herein with respect to the dynamicjoystick and wand functionalities.

Smart zoom functionality may provide a zoom control by one or more ofzoom-in by an input and zoom-out by an input, wherein the input may be acontact command. The zoom control can also allow for zooming-in to thefull extent of the surveying device by an input, and zooming-out to thefull extent of the surveying device by an input. According to oneembodiment, smart zoom functionality may allow for detection of one ormore input clicks or taps on a control screen and controlling asurveying device based on the number of clicks or taps and the positionthe clicks or taps are detected on the control screen.

According to one embodiment, the smart zoom functionality may react todirect input to an image displayed by a control device to aim crosshairsand/or imaging device of the surveying device. Smart zoom may also allowfor providing a zoom between one or more imaging devices, to change anoptical zoom level, and change a digital zoom level. The smart zoomfunctionality may also be configured to react to a combination of aimand zoom commands. According to one embodiment, aim and zoom commandsmay be provided using the same input capabilities of the control device.For example, contact of a control screen by user touch or a stylus mayprovide one or more of an aim command, zoom command, and camera switchcommand.

Referring now to FIGS. 10A-10C, graphical representations are depictedof a control screen and smart zoom functionality. FIG. 10A depicts agraphical representation of control screen display 1005. Control screendisplay 1000 may include presentation of image data 1005 captured by asurveying device. According to one embodiment, smart zoom functionalitymay allow for a user to navigate to one or more zoom stages based oninput to one or more portions of control screen display 1005. In oneembodiment, inner circle 1010 may relate to a zoom in area and area 1015surrounding inner circle 1010 may be a zoom-out area. Based on one ormore of single, double and triple clicks via user touch or use of astylus on control screen display 1000, the surveying device may navigateto one or more zoom stages. Scroll bars 1020 and 1025 may be clicked andadjusted to reorient a surveying device according to one embodiment.Similarly, control screen display 1000 may include an inset image 1030providing a graphical representation of the image data 1005 relative toimage data that may be captured without zoom for a current orientationof the surveying device. Inset image 1030 may relate to an overviewimage and may be hid from control screen display 1000.

Referring now to FIG. 10B, graphical representation of the controlscreen display of FIG. 10A is depicted. Control screen 1040 identifieszoom-in area 1045 and zoom-out area 1050. Based on an input, such asuser touch or contact of a stylus with zoom-in area 1045, the controldevice may control surveying device to zoom-in. Similarly, based on aninput, such as user touch or contact of a stylus with zoom-out area1050, the control device may control surveying device to zoom-out. Inone embodiment, a double-click in zoom-in area 1045 may result in thesurveying device increasing zoom by a single factor, where atriple-click in zoom-in area 1045 may zoom-in to a full extent of thesurveying device. A double-click in zoom-out area 1050 may result in thesurveying device decreasing zoom by a single factor, where atriple-click in zoom-out area 1050 may zoom-out to the full extent ofthe surveying device. When zoom-in or zoom-out to the full extent, thesurveying device may be configured to select a different imaging deviceor camera. Selection of a different camera and display of image data maybe seamless, such that a user does not experience delay in presentationof image date from a first to a second camera of the surveying device.Single clicks (e.g., a single tap) or contact inputs to control screendisplay 1040 may result in the survey device turning to the desiredposition.

Control screen display 1040 may include an inset image 1055 providing agraphical representation of the image data that may be navigated to bythe surveying device for an orientation of the surveying device. Insetimage 1055 may include display element 1060 identifying the particularzoom position relative to overview image. In certain embodiments,selections or inputs may be tracked within inset image 1055 for aiming asurveying device.

Referring now to FIG. 10C, a graphical representation is depicted ofcontrol screen display according to another embodiment. Control screendisplay 1065 allows for display of image data, such as video image data,and turning and zooming the surveying device based on one or more inputsrelative to display of the video image data. According to oneembodiment, zoom-in functionality is provided by an input on the displayof video image data 1070. By way of example, zoom-in functionality isprovided to areas within and outside of the inner circle 1075 of controlscreen display 1065. Zoom-out functionality is provided by an input toselection of overview image 1055.

In one embodiment, a double-click in display area 1070 may result in aturn to the selected point and increase of zoom a single factor. Atriple-click in display area 1070 may turn and zoom-in to the fullextent. A double-click in overview image 1055 may result in a turn tothe selected point and zoom-out by a single factor. A triple-click inoverview image 1055 may result in a turn to the selected point andzoom-out to the full extent.

According to one embodiment, the smart zoom functionality may beintegrated with the dynamic joystick functionality. For example, dragcommands of a control device for turning a surveying device may bedetected in combination or association with smart zoom commands. Smartzoom functionality may additionally be configured to allow for a zoom ina three dimensional view, map view and to one or more points ofinterest. Smart zoom may similarly allow for a zoom to one or more of aprism, GNSS, point, start of line, arc, etc. Smart zoom functionalitymay additionally be configured for selecting or zooming relative to oneor more points in a three-dimensional display.

Referring now to FIGS. 11A-11B, graphical representations of smart zoomfunctionality are depicted according to one or more embodiments. FIGS.11A-11B depict multiple operation paths 1100 that may be employed tonavigate to one or more zoom levels of a surveying device.

Referring first to FIG. 11A, a control device (e.g., control device 105)may connect to a surveying instrument (e.g., surveying device 110) atblock 1105 and display live video data on a control screen at block1110. The control device may be configured to display image dataassociated with a first camera (e.g., camera A in FIG. 11A) of thesurveying device at block 1115. Camera A may be set to a zoom level ofzero (e.g., no zoom or zoom out to the fullest extent) at block 1115.Based on a user input to aim or control display of image data, thecontrol device may generate one or more commands for a surveying device.Exemplary input commands in FIG. 11A include a single click on a controlscreen 1120, double click on zoom-in area 1125, double click zoom-outarea 1130, triple click on zoom in area 1135 and triple click zoom-outarea 1140.

From block 1115 to a single click on a control screen 1120, to a doubleclick on zoom-out area 1130, or to triple click zoom-out area 1140, thesurveying instrument may move to a new position at block 1145 based onthe input. From block 1115 to a double click on zoom-in area 1125, thesurveying instrument may move to a new position and adjust zoom at block1150 based on the input. Based on the adjustment and navigation to azoom level, the surveying device may present a zoom level, such as azoom-in level, at block 1155. From block 1115 to a triple click onzoom-in area 1135 the surveying device may move to a new position andzoom to the full extent with block 1184, zoom level three of FIG. 11B.

From a zoom level of a first camera at block 1155, the control devicemay receive one or more smart zoom commands. From a zoom level at block1155 to a single click on a control screen 1120, the surveyinginstrument may move to a new position at block 1160 based on the input.From a zoom level at block 1155 to a double click on zoom-in area 1125,the surveying instrument may be reoriented and adjust a zoom level atblock 1165. In FIGS. 11A-11B, the additional level of zoom is describedas switching to a separate imaging device. However, it should beappreciated that a single imaging in device may provide a plurality(e.g., 20 or more) zoom levels. From a zoom level at block 1155 to adouble click on zoom-out area 1130 or triple click on zoom-out area1140, the surveying instrument may be reoriented and adjust zoom levelzero at block 1170. From a zoom level at block 1155 to a triple click onzoom-in area 1135, the surveying instrument may be reoriented and adjusta zoom level three of a second camera at block 1175.

Referring now to FIG. 11B, a second camera of a surveying device mayprovide a zoom level at block 1180. The zoom levels of a second cameraof the surveying device (e.g., camera B in FIG. 11B) may provide anincreased zoom (e.g., relative to camera A). From block 1180, thecontrol device may receive one or more smart zoom commands. From a zoomlevel at block 1180 to a single click on a control screen 1120, thesurveying instrument may move to a new position at block 1181 based onthe input. From a zoom level at block 1180 to a double click on zoom-inarea 1125, the surveying instrument may be reoriented and adjust azoom-in level at block 1182. From a zoom level at block 1180 to a doubleclick on zoom-out area 1130, the surveying instrument may be reorientedand adjust zoom-out level at block 1183, the zoom level set to block1155. From a zoom level at block 1180 to a triple click on zoom-in area1135, the surveying instrument may be reoriented and adjust a zoom-in tolevel three of a second camera at block 1184.

Zoom level three at block 1185, may relate to the full extent asurveying device may zoom-in. From block 1185 to a single click on acontrol screen 1120, to a double click on zoom-in area 1125, or tripleclick on zoom-in area 1135, the surveying instrument may move to a newposition at block 1186 based on the input. From block 1185 to a doubleclick on zoom-out area 1130, the surveying instrument may move to itsnew position and zoom at block 1188 to zoom level two at block 1180.From a zoom level at block 1180 or block 1185 to a triple click onzoom-out area 1140, the surveying device may change to camera A andselect a first zoom level at block 1187.

Although operation paths 1100 of FIGS. 11A-11B are described relative tofour zoom levels and two cameras on a surveying device, it should beappreciated that the embodiments disclosed herein may be applied toother arrangements. For example, in one the surveying device may includea single camera. In another embodiment the surveying device may includemultiple image devices. In yet another embodiment, the surveying devicemay display image data from another source. It should also beappreciated that the disclosure is no limited to four zoom levels.

While this disclosure has been particularly shown and described withreferences to exemplary embodiments thereof, it will be understood bythose skilled in the art that various changes in form and details may bemade therein without departing from the scope of the embodimentsencompassed by the appended claims.

1-59. (canceled)
 60. A method for controlling a surveying device, themethod comprising the acts of: displaying, by a device, a control screenincluding image data captured by a surveying device; detecting an inputassociated with the control screen, wherein the input is based on motionof a control device; determining a control command for the surveyingdevice based on the input associated with the control screen; andcontrolling, by the device, operation of the surveying device based onthe control command, wherein the surveying device is configured torotate in one more of a horizontal and vertical direction based on thecontrol command.
 61. The method of claim 60, wherein the control screendisplays one or more of image and video data received by the surveyingdevice.
 62. The method of claim 60, wherein the surveying device isconfigured for one or more of an electronic distance measurement,coordinate determination and angular measurement.
 63. The method ofclaim 60, wherein the control command adjusts the position of thesurveying device based on motion characteristics of the input command.64. The method of claim 60, wherein the control command translatesmotion of the control device to control movement of the surveyingdevice.
 65. The method of claim 60, wherein the control commandtranslates a tracked length of the input to an adjustment command,wherein the adjustment command is scaled to provide one of a fine andcoarse adjustment.
 66. The method of claim 60, wherein the controlcommand adjusts the surveying device in a direction opposite to theinput command.
 67. The method of claim 60, wherein the control commandfilters movement of the input command in one axis.
 68. The method ofclaim 60, wherein the control command causes reduced movement in thevertical axis relative to the horizontal axis.
 69. The method of claim60, wherein the control command scales the movement of the input commandbased on a distance measurement performed by the surveying device. 70.The method of claim 60, further comprising initiating a tracking routineof the input based on motion of the control device.
 71. The method ofclaim 60, further comprising updating the display of the control devicebased on image data received from the surveying device following thecontrol command.
 72. A system comprising: a surveying device, and acontrol device configured to control operation of the surveying device,the control device comprising a processor configured to: display acontrol screen including image data captured by a surveying device;detect an input associated with the control screen, wherein the input isbased on motion of a wand device; determine a control command for thesurveying device based on the input associated with the control screen;and control, by the device, operation of the surveying device based onthe control command, wherein the surveying device is configured torotate in one more of a horizontal and vertical direction based on thecontrol command.
 73. The system of claim 72, wherein the control screendisplays one or more of image and video data received by the surveyingdevice.
 74. The system of claim 72, wherein the surveying device isconfigured for one or more of an electronic distance measurement,coordinate determination and angular measurement.
 75. The system ofclaim 72, wherein the control command adjusts the position of thesurveying device based on motion characteristics of the input command.76. The system of claim 72, wherein the control command translatesmotion of the wand device to control movement of the surveying device.77. The system of claim 72, wherein the control command translates atracked length of the input to an adjustment command, wherein theadjustment command is scaled to provide one of a fine and coarseadjustment.
 78. The system of claim 72, wherein the control commandadjusts the surveying device in a direction opposite to the inputcommand.
 79. The system of claim 72, wherein the control command filtersmovement of the input command in one axis.
 80. The system of claim 72,wherein the control command causes reduced movement in the vertical axisrelative to the horizontal axis.
 81. The system of claim 72, wherein thecontrol command scales the movement of the input command based on adistance measurement performed by the surveying device.
 82. The systemof claim 72, further comprising initiating a tracking routine of theinput based on motion of the wand device.
 83. The system of claim 72,further comprising updating the display of the control device based onimage data received from the surveying device following the controlcommand.